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Abstract 

Algebraic independence is an advanced notion in commutative algebra that 
generalizes independence of linear polynomials to higher degree. Polynomials 
{/i, . . . , fm} C F[j;i, . . . , Xn] are called algebraically independent if there is no 
non-zero polynomial F such that . . . , /„) = 0. The transcendence degree, 

trdeg{/i, . . . , fm}, is the maximal number r of algebraically independent polyno- 
mials in the set. In this paper we design blackbox and efficient linear maps ip 
that reduce the number of variables from n to r but maintain trdeg{(/9(/j)}j = r, 
assuming /j's sparse and small r. We apply these fundamental maps to solve 
several cases of blackbox identity testing: 

1. Given a polynomial-degree circuit C and sparse polynomials 

with trdeg r, we can test blackbox D := C(/i,...,/m) for zeroness in 
poly(size(D))'" time. 

2. Define a T,I[T,I[s{k, s, n) circuit C to be of the form X^fL;^ 11^=1 where 
fij are sparse n-variate polynomials of degree at most d. For k = 2 we give 
a poly{5sn)^^ time blackbox identity test. 

3. For a general depth-4 circuit we define a notion of rank. Assuming there 
is a rank bound R for minimal simple 'SH'SIi g {k, s,n) identities, we give 
a poly{5snR)^''^ time blackbox identity test for Y^HY^Hsik, s,n) circuits. 
This partially generalizes the state of the art of depth-3 to depth-4 circuits. 

The notion of trdeg works best with large or zero characteristic, but we also give 
versions of our results for arbitrary fields. 

Keywords: Algebraic independence, transcendence degree, arithmetic circuits, 
polynomial identity testing, blackbox algorithms, depth-4 circuits. 
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1 Introduction 



Polynomial identity testing (PIT) is the problem of checking whether a given n-variate 
arithmetic circuit computes the zero polynomial in ¥[xi, . . . It is a central ques- 
tion in complexity theory as circuits model computation and PIT leads us to a better 
understanding of circuits. There are several classical randomized algorithms known 
jPlTfSl ISchSOl [Zi^ [CKOOl ILV981 RB03] that solve PIT. The basic Schwartz-Zippel 
test is: given a circuit C{xi, . . . ,Xn), check C(a) = for a random a G F . Finding a 
deterministic polynomial time test, however, has been more difficult and is currently 
open. Derandomization of PIT is well motivated by a host of algorithmic applica- 
tions, eg. bipartite matching |Lov79j and matrix completion |Lov89j . and connections 
to sought-after super-polynomial lower bounds |HS80t lKI04j . Especially, blackboxPYT 
(i.e. circuit C is given as a blackbox and we could only make oracle queries) has di- 
rect connections to lower bounds for the permanent |Agr05 , Agr06] . Clearly, finding a 
blackbox PIT test for a family of circuits J-" boils down to efficiently designing a hitting 
set Ti C ¥ such that: given a nonzero C G J-", there exists an a G that hits C, i.e. 
C{a) ^ 0. 

The attempts to solve blackbox PIT have focused on restricted circuit families. A 
natural restriction is constant depth. Agrawal & Vinay |AV08] showed that a blackbox 
PIT algorithm for depth-4 circuits would (almost) solve PIT for general circuits (and 
prove exponential circuit lower bounds for permanent). The currently known blackbox 
PIT algorithms work only for further restricted depth-3 and depth-4 circuits. The case 
of bounded top fanin depth-3 circuits has received great attention and has blackbox PIT 
algorithms jUSM iKSOTl iKSOSl iKSOOl [SSTOllSSTT] . The analogous case for depth-4 
circuits is open. However, with the additional restriction of multilinearity on all the 
multiplication gates, there is a blackbox PIT algorithm |KMSV10l ISVll] . The latter 
is somewhat subsumed by the PIT algorithms for constant-read multilinear formulas 
|AvMV10] . To save space we would not go into the rich history of PIT and instead 
refer to the surveys [SaxOQt ISYlOj . 

A recurring theme in the blackbox PIT research on depth-3 circuits has been that of 



rank. If we consider a EnE(fc, n) circuit C = Y2^=i Y['j=i where iij are linear forms 
in F[a;i, . . . , Xn], then rk(C) is defined to be the hnear rank of the set of forms 
each viewed as a vector in F". This raises the natural question: Is there a generalized 
notion of rank for depth-4 circuits as well, and more importantly, one that is useful 
in blackbox PIT? We answer this question affirmatively in this paper. Our notion of 
rank is via transcendence degree (short, trdeg), which is a basic notion in commutative 
algebra. To show that this notion applies to PIT requires relatively advanced algebra 
and new tools that we build. 

Consider polynomials {/i,...,/^} in ¥[xi, . . . ,Xn]- They are called algebraically 
independent (over F) if there is no nonzero polynomial F G ¥[yi, . . . ,ym] such that 
F(/i, . . . , fm) = 0. When those polynomials are algebraically dependent then such an F 
exists and is called the annihilating polynomial of fi,..., fm- The transcendence degree, 
trdeg{/i, . . . , fm}, is the maximal number r of algebraically independent polynomials 
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in the set {/i, . . . , /m}- Though intuitive, it is nontrivial to prove that r is at most n 
|Mor96] . The notion of trdeg has appeared in complexity theory in several contexts. 
Kalorkoti |Kal85] used trdeg to prove an fi(n^) formula size lower bound for n x n 
determinant. In the works jPGWOQ] IDGRVlI] studying the entropy of poljTiomial 
mappings (/i, . . . , /„) : F" — )■ F"^, trdeg is a natural measure of entropy when the field 
has large or zero characteristic. It also appears implicitly in |Dvi09j while constructing 
extractors for varieties. Finally, the complexity of the annihilating polynomial is studied 
in |Kay09| . However, our work is the first to study trdeg in the context of PIT. 

1.1 Our main results 

Our first result shows that a general arithmetic circuit is sensitive to the trdeg of its 
input. 

Theorem 1. Let C he an m-variate circuit. Let /i,...,/^ he i-sparse, 6-degree, n- 
variate polynomials with trdeg r. Suppose we have oracle access to the n-variate d- 
degree circuit C := C(/i, . . . , fm)- There is a hlackhox poly(size(C") ■ diSy time test to 
check C = (assuming a zero or larger than 6'' characteristic) . 

We also give an algorithm that works for all fields but has a worse time com- 
plexity. Note that the above theorem seems nontrivial even for a constant m, say 
C = C{fi, f2, fs), as the output of C may not be sparse and /j's are of arbitrary 
degree and arity. In such a case r is constant too and the theorem gives a polynomial 
time test. Another example, where r is constant but both m and n are variable, is: 
fi := {x\ + xl + h xDxl^ for i G [m]. (Hint: r < 3.) 

Our next two main results concern depth-4 circuits. By T,IlT,Ils{k, s,n) we denote 
circuits (over a field F) of the form 



where /i,/s are sparse ra-variate polynomials of maximal degree 6. Note that when 6 = 1 
this notation agrees with that of a SHE circuit. Currently, the PIT methods are not 
even strong enough to study SHSH5(/c, s, n) circuits with both top fanin k and hottom 
fanin 6 hounded. It is in this spectrum that we make exciting progress. 

Theorem 2. Let C he a SHSH5(2, s, circuit over an arhitrary field. There is a 
hlackhox po\j{6snY^ time test to check C = 0. 

Simple, minimal and rank Finally, we define a notion of rank for depth-4 cir- 
cuits and show its usefulness. For a circuit C, as in ([T]), we define its rank, rk(C) : = 
trdeg{/ij I i G [k],j G [s]}. Define Tj := Y[j=ifi,jy ^ ^ be the multi- 

plication terms of C. We call C simple if {Tj | i G [k]} are coprime polynomials. We 
call C minimal if there is no J C [k] such that 'Ylii^i^i = 0. Define Rs{k, s) to be the 



k 
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smallest r such that: any TiIlTiIls{k, s,n) circuit C that is simple, minimal and zero 
has rk(C) < r. 

Theorem 3. Let r := Rs{k,s) and the characteristic be zero or larger than . There 
is a hlackhox Y>o\y{5rsny^^^ time identity test for TIHlIi^ik, s^n) circuits. 

We give a lower bound of VL{5k\ogs) on Rs{k,s) and conjecture an upper bound 
(better than the trivial ks). 

1.2 Organization and our approach 

A priori it is not clear whether the problem of deciding algebraic independence of given 
polynomials {/i, . . . , fm}, over a field F, is even computable. Perron |Per27j proved that 
for m = (n + 1) and any field, the annihilating polynomial has degree only exponential 
in n. We generalize this to any m in Sect. 12. hence, deciding algebraic independence 
(over any field) is computable. When the characteristic is zero or large, there is a more 
efficient criterion due to Jacobi (Sect. 12. 2p . For using trdeg in PIT we would need to 
relate it to the Krull dimension of algebras (Sect. 12. 3p . 

The central concept that we develop is that of a faithful homomorphism. This 
is a linear map from R := F[a;i, . . . , x„] to ¥[zi, . . . , Zr] such that for polynomials 
fi, fm ^ R of trdeg r, the images (p{fi), ■ ■ ■ , ^p{fm) are also of trdeg r. Additionally, 
to be useful, (p should be constructible in a blackbox and efficient way. We give such 
constructions in Sects. 13. H and [3.2[ The proofs here use Perron's and Jacobi's criterion, 
but require new techniques as well. The reason why such a is useful in PIT is because 
it preserves the nonzeroness of the circuit C(/i, . . . , fm) (Corollary [13]). We prove this 
by an elegant application of Krull's principal ideal theorem. 

Once the fundamental machinery is set up, we prove Theorem [1] by designing a 
hitting set. The zero or large characteristic case is handled in Sect. 14.11 The arbitrary 
characteristic case is in Sect. 14.21 

Finally, we apply the faithful homomorphisms to depth-4 circuits. The proof of 
Theorem [2] is provided in Sect. 15.21 The rank-based hitting set is constructed in Sect. 
15.31 proving Theorem [3l The full proofs tend to be extremely technical and have been 
moved to the appendix. 

2 Preliminaries: Perron, Jacobi & Krull 

Let n G Z+ and let i^' be a field of characteristic ch(i^'). Throughout this paper, 
K[x] = K[ Xi,...,Xn\ is a polynomial ring in n variables over K. K denotes the 
algebraic closure of the field. We denote the multiplicative group of units of an algebra 
A by A* . We use the notation [n] := {1, . . . , n). For < r < n, ('"^) denotes the set of 
r-subsets of [n]. 
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2.1 Perron's criterion (arbitrary field) 

Let f\,---,fm £ K[x] be polynomials. When we want to emphasize the base field 
with the transcendence degree, we would use the notation trdeg^{/i, . . . , /„}. It is 
interesting to note that transcendence degree is invariant to algebraic field extensions, 
i.e. trdeg^{/i, . . . , /m} is the same as trdeg;^{/i, . . . , (Lemma 1271). The name 
transcendence degree stems from field theory. The transcendence degree of a field 
extension L/K, denoted by trdeg(L/if), is the cardinality of any transcendence basis for 
L/K (for more information on transcendental extensions, see |Mor96t Chap. 19]). For 
L = K{fi, fm), we have trdeg;^{/i, . . . , fm} = tideg^L/K) (cf. |Mor96[ Theorem 
19.14]). Since tTdeg{K (x) / K) = n, we obtain < trdeg;^{/i, . . . , fm} < n. 

Algebraic independence over K strongly resembles ii'-linear independence. In fact, 
algebraic independence makes a finite subset {/i,...,/^} C K[x] into a matroid (a 
generalization of vector space, cf. |Oxl06l Sect. 6.7]). 

An effective criterion for algebraic independence can be obtained by a degree bound 
for annihilating polynomials. The following theorem provides such a bound for the case 
of + 1 polynomials in n variables. 

Theorem 4 (Perron's theorem). |Plo05l Theorem 1.1] Let fi G K[x\ he a polyno- 
mial of degree 5i > 1, for i G [?7, + 1]. Then there exists a non-zero polynomial 
F G K[yi, . . . ,?/„+i] such that F(/i, . . . , /„+i) = and deg(F) < (Hi (^i)/ minj{(5i}. 

In the following corollary we give a degree bound in the general situation, where 
more variables than polynomials are allowed. Moreover, the bound is in terms of the 
trdeg of the polynomials instead of the number of variables. We hereby improve |Kay09 , 
Theorem 11] and generalize it to arbitrary characteristic. The proof uses a result from 
Sect. [3] and is given in Appendix lA.li 

Corollary 5 (Degree bound for annihilating polynomials). Let fi,...,fm G K[x] be 
algebraically dependent polynomials of maximal degree 6 and trdeg r . Then there exists a 
non-zero polynomial F G K[yi, . . . , ?/„] of degree at most 6^ such that F{fi, . . . , fm) = 0. 

Proof sketch. In Lemma [H] we construct a homomorphism (by first principles) that 
reduces the number of variables to r and preserves the trdeg. We can then invoke 
Perron's theorem on r + 1 of the polynomials. □ 

Remark. The bound in Corollary [5] is tight. To see this, let n > 2, let 5 > 1 and 
define the polynomials, /i := Xi, := X2 - xf, /„ := x„ - x^„i, /„+i := x^ in 
K[x]. Then trdeg{/i, . . . , /„+i} = n and every annihilating polynomial of /i, . . . , /„+i 
has degree at least 5". 

2.2 Jacobi's criterion (large or zero characteristic) 

In large or zero characteristic, the well-known Jacobian criterion yields a more efficient 
criterion for algebraic independence. 
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For i E [n], we denote the i-th formal partial derivative of a polynomial / G K[x] 
by d^J. Now let /i, . . . , e K[x]. Then 



/ dxji 



dxji\ 



Jxifl, ■ ■ ■ , fm) '■— ipXjfi) 



e K[x\ 




is called the Jacobian matrix of /i, . . . , fm- Its matrix-rank over the function field is of 
great interest. 

Theorem 6 (Jacobian criterion). Let fi,...,fm € K[x] be polynomials of degree at 
most 6 and trdeg r. Assume that ch(i^) = or ch(i^') > 6^. Then rk/, Jx{fi, ■ ■ ■ , fm) = 
trdeg^{/i, . . . , fm}, where L = K{x). 

A proof of the Jacobian criterion in characteristic appears, for example, in |ER93j 
and the case of large prime characteristic was dealt with in |DGW09] . By virtue of 
Theorem H] our proof could tolerate a slightly smaller characteristic. For the reader's 
convenience, a full proof is given in Appendix IA.2I We isolate the following special case 
of Theorem |6], because it holds in arbitrary characteristic. 

Lemma 7. Let fi, . . . , fm e K[x]. Then trdeg^{/i, . . . , fm} > rk^ ^(/i, . . . , 
where L = K{x). 

2.3 Krull dimension of affine algebras 

In this section, we want to highlight the connection between transcendence degree and 
the Krull dimension of affine algebras. This will enable us to use KruU's principal ideal 
theorem which is stated below. 

In this paper, a K -algebra A is always a commutative ring containing 7^ as a subring. 
The most important example of a i^'-algebra is i^'[a:;]. Let A,B be i^'-algebras. A map 
A — 7- i? is called a K-algebra homomorphism if it is a ring homomorphism that fixes K 
element- wise. 

We want to extend the definition of algebraic independence to algebras (whose 
elements may not be the usual polynomials any more). Let 0,1, ... , Om G A and consider 
the iiT-algebra homomorphism 



where K[y] = K[yi, . . . , If ker(p) = {0}, then {oi, . . . , a^} is called algebraically 
independent over K. If ker(p) 7^ {0}, then {oi, . . . , a^} is called algebraically dependent 
over K. For a subset S* C A, we define the transcendence degree of S over K by an 
obvious supremum: 



p : K[y] A, 



F h-> F(ai, . . .,am), 



trdeg;^(5') := sup{|T| | T C 5* is finite and algebraically independent}. 
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The image of K[y\ under p is the subalgebra of A generated by ai, . . . , and is denoted 
by K[ai, . . . , am]- An algebra of this form is called an affine K -algebra, and it is called 
an affine K-domain if it is an integral domain. 

The Krull dimension of A, denoted by dim(y4), is defined as the supremum over all 
r > for which there is a chain po $ Pi ^ ■ ■ " S Pr of prime ideals pj C A. It measures 
how far A is from a field. 

Theorem 8 (Dimension and trdeg). Let A = K[ ] be an affine K-algebra. 

Then dim(y4) = trdeg^(y4) = trdeg^^jai, . . . , a^}- 

Proof. Cf. [Kemllt Theorem 5.9 and Proposition 5.10]. Also, the integral domain case 
is in the standard text |Mat89i Theorem 5.6]. □ 

The following corollary is a simple consequence of Theorem [81 It shows that ho- 
momorphisms cannot increase the dimension of affine algebras. The proof is given in 
Appendix IA.3I 

Corollary 9. Let A, B be K -algebras and let ip : A —> B be a K-algebra homomorphism. 
If A is an affine algebra, then so is (p{A) and we have dim{{p{A)) < dim{A). If, in 
addition, (p is injective, then dim{(f{A)) = dim{A). 

In the next section we will need the following version of KruU's principal ideal 
theorem. 

Theorem 10 (KruU's Hauptidealsatz). Let A be an affine K-domain and let a G 
A\{A*U {0}). Then dim(A/(a)) = dim(A) - 1. 

Proof Cf. pi95l Corollary 13.11] or |Mat89l Theorem 13.5]. □ 

3 Faithful homomorphisms: Reducing the variables 

Let /i,...,/m £ K[x] be polynomials and let r := trdeg{/i, . . . , /m}. Intuitively, r 
variables should suffice to define fi, ■ ■ ■ , fm without changing their algebraic relations. 
So let K[z] = K[ Zi, . . . , Zr] be a polynomial ring with 1 < r < n. We want to find 
a homomorphism K[x] — )■ K[z] that preserves the transcendence degree of fi, . . . , fm- 
First we give this property a name. 

Definition 11. Let (f : K[x] ^ K[z] be a K-algehia homomorphism. We say (p is 
faithful to {/i, . . . , fm} if trdeg{v9(/i), . . . , (p{fm)} = trdeg{/i, . . . , 

The following theorem shows that faithful homomorphisms are useful for us. 

Theorem 12 (Faithful is useful). Let A = K[fi, . . . , fm] ^ /^[a:;]. Then ip is faithful to 
{/i, ■ ■ • ,/m} if and only if lp\a ■ A K[z] is mjective (iff A = K[Lp{fi), . ..,Lp{fm)])- 
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Proof. We denote (pA = '^Ia and r = trdeg{/i, . . . , fm}- If ^Pa is injective, then 

r = dim(A) = dim((/?A(^)) = trdeg{y?(/i), . . . , (f{fm)} 

by Theorem [H] and Corollary O Thus ip is faithful to {/i, . . . , /m}. 

Conversely, let (p be faithful to {/i, . . . , /m}- Then dim{ipA{A)) = r. Now assume 
for the sake of contradiction that (pA is not injective. Then there exists an / G A \ {0} 
such that ^aH) = 0. We have f ^ K, because ip fixes K element- wise, and hence 
/ ^ A*. Since A is an affine domain. Theorem fTU] implies dim(yl/(/)) = r — 1. Since 
/ G ker((y9^), the i^'-algebra homomorphism 

Tp^:A/{f)^K[z], a+{f)^^Aia) 

is well-defined and ipA factors as cpA = Wa ° where rj : A ^ A/{f) is the canonical 
surjection. But then Corollary [9] implies 

r = dim{ipA{A)) = dim{-ip^{'r]{A))) < dim(?7(yl)) = dim(A/(/)) = r - 1, 

a contradiction. It follows that (pA is injective. 

When (fA is injective, clearly we have A = ipA^A) = K[(p{fi), . . . , ip{fm)]- □ 

Corollary 13. Let C he an m-variate circuit over K . Let (p he faithful to {/i, . . . , fm} 
C K\x\. Then, C^fu ■ ■ ■ Jm) = zjf C{M), . . . , ipifm)) = 0. 

Proof. Note that C(/i, . . . , fm) resp. C{(p{fi), . . . , (p{fm)) are elements in the algebras 
K[fi, . . . , fm] resp. K[ip{fi), . . . , ip{fm)]- Since is an isomorphism between these two 
algebras, the corollary is evident. □ 

3.1 A Kronecker-inspired map (arbitrary characteristic) 

The following lemma shows that even linear faithful homomorphisms exist for all sub- 
sets of polynomials (provided K is large enough, for eg. move to i^' or a large enough 
field extension |AL86] ). It is a generalization of |Kay09 Claim 11.1] to arbitrary char- 
acteristic. The proof is given in Appendix IB. II 

Lemma 14 (Existence). Let K he an infinite field and let fi, . . . , fm G K[x] he polyno- 
mials o/trdeg r. Then there exists a linear K-algehra homomorphism ip : K[x] — )■ K[z] 
which is faithful to {fi, . . . , fm}- 

Proof sketch. We prove this by first principles. The proof is by identifying r variables 
from {xi, . . . , Xn} that we leave free and the rest n—r variables we fix to generic elements 
from K. Using annihilating polynomials we could show that this map preserves the 
trdeg. □ 
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Below we want to make this lemma effective. This will again be accomplished by 
substituting constants for all but r of the variables xi, . . . , x„. We define a parametrized 
homomorphism $ in three steps. First, we decide which variables we want to keep and 
map them to zi, . . . , Zr- To the remaining variables we apply a Kronecker substitution 
using a new variable t, i.e. we map the i-th variable to t^' (for a large D). In the 
second step, the exponents of t will be reduced modulo some number. Finally, a single 
constant will be substituted for t. 

Let / = {ji, . . . ,jr} G be an index set and let [n] \ I = {jr+i, ■ ■ ■ , jn} be its 
complement such that ji < ■ ■ ■ < jr and jr+i < ■ ■ ■ < in- Let D > 2 and define the 
/T-algebra homomorphism 

<^>j,n:K[x]^K[t,z], x,, K ioT^ = l r, 

I t , for z = r + 1, . . . , n. 

Now let p > 1. For an integer a G Z, we denote by [a\p the integer h E 'L satisfying 
< 6 < p and a = b (mod p). We define the i^-algebra homomorphism 



^I^D,p- K[x]-> K[t,z], Xj^^-¥ 



Zi, for i = 1, . . . ,r, 

^[D'-'-jp for 2 = r + 1, . . . , n. 



Note that, for / G K[x], ^i,D,p{f) is a representative of the residue class $/,d(/) 
(mod (t^ — l)K[t,z])- Finally let c G K and define the i^'-algebra homomorphism 

<!>i,D,p,c : K[x] ^ K[z], f ^ (<l>,,z),p(/))(c,2). 

The following lemma bounds the number of bad choices for the parameters p and c. It 
is proven in Appendix lB.il 

Lemma 15 ($ is faithful). Let /i, . . . , G K[x] be polynomials of degree at most S 
and trdeg at most r. Let D > 6^'~^^. Then there exist an index set I G ('"^) and a prime 
p < {n + S^)^^'~^^ {\og2 + 1 such that any subset of K of size 6'^rp contains c such 
that $/,D,p,c faithful to {/i, . . . , /„}. 

Proof sketch. We identify a maximal / C [n] such that for the field L := K{xi \ i ^ I), 
trdeg2,{/i, . . . , fm} = trdeg;^{/i, . . . , fm}- Now Xj, for z G /, is algebraic over the field 
L(/i, . . . , /m). This gives us annihilating polynomials whose degrees we could bound 
by Corollary |5l and hence their sparsities. By sparse PIT tricks we get a bound on the 
'good' p and c. □ 

In large or zero characteristic, a more efficient version of this lemma can be given 
(for the same homomorphism $). The reason is that we can work with the Jacobian 
criterion instead of the degree bound for annihilating polynomials. However, we omit 
the statement of this result here, because we can give a more holistic construction in 
that case. This will be presented in the following section. 



9 



3.2 A Vandermonde-inspired map (large or zero characteris- 
tic) 

To prove Theorem [31 we will need a homomorphism that is faithful to several sets of 
polynomials simultaneously. The homomorphism $ constructed in the previous section 
does not meet this requirement, because its definition depends on a fixed subset of 
the variables Xi, . . . In this section we will devise a construction, that treats the 
variables uniform manner. It is inspired by the Vandermonde matrix, 

i.e. ((f^)),,,. 

We define a parametrized homomorphism \[' in three steps. Let K[z] = K[zq, . . . , Zr], 
where 1 < r < n. Let Di,D2 > 2 and let D = {Di,D2). Define the i^'-algebra 
homomorphism 

r 

: K[x] K[t, z], Xi ^ + t^ho + J]] f 

i=i 

where i = 1, . . . ,n. This map (linear in the z's) should be thought of as a variable 
reduction from n to r + 1. The coefficients of zi,. . . ,Zr bear resemblance to a row 
of a Vandermonde matrix, while that of zq (and the constant coefficient) resembles 
Kronecker substitution. This definition is carefully tuned so that finally preserves 
both the trdeg (proven here) and gcd of polynomials (proven in Sect. 15.21) . 
Next let p > 1 and define the ilT-algebra homomorphism 

r 

^D,p : K[x] K[t,z], Xi ^ t^Di], ^^[Di\,^^ + ^tWn+iyjp^.^ 

where i = 1, . . . ,n. Note that, for / G K[x], \E'd,p(/) is a representative of the residue 
class "^oif) (mod (t^ — l)K[t,z])- Finally let c G and define the i^'-algebra homomor- 
phism 

<i/n,p,c : K[x] ^ K[z], f ^ (M/z5,p(/)) (c, 2;). 

The following lemma bounds the number of bad choices for the parameters p and c. 
The proof, which is given in Appendix IB.2| uses the Jacobian criterion, therefore the 
lemma has a restriction on ch.{K). 

Lemma 16 (^^ is faithful). Let fi, . . . , fm G K[x] be polynomials of sparsity at most 
i, degree at most S and trdeg at most r. Assume that ch(i^) = or ch.{K) > 6^ . Let 
D = {Di, D2) such that Di > max{6r + 1, (n + l)^"*"^} and D2 > 2. Then there exists 
a prime p < (2nriY^'^'^^\\og2 -Di)^ + 1 such that any subset of K of size 5rp contains c 
such that '^D,p,c is faithful to {/i, . . . , fm}- 

Proof sketch. We study the action of \I' 15 on the Jacobian determinant. Because of the 
chain rule of partial derivatives, this leads us to a product of two determinants, which 
we expand using the Cauchy-Binet formula and estimate its sparsity. By sparse PIT 
tricks we get a bound on the 'good' p and c. □ 
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By trying larger p and c, we can find a \l/ that is faithful to several subsets of 
polynomials simultaneously. This is an advantage of \1/ over $, in addition to being 
more efficiently constructible. 

4 Circuits with sparse inputs of low transcendence 
degree (proving Theorem [Ij) 

We can now proceed with the first PIT application of faithful homomorphisms. We 
consider arithmetic circuits of the form C{fi, . . . , fm), where C is a circuit comput- 
ing a polynomial in K[y] = K[yi, . . . ,ym] and /i, . . . , are subcircuits computing 
polynomials in K[x]. Thus, C{fi, . . . , fm) computes a polynomial in the subalgebra 

Let C(/i, . . . , fm) be of maximal degree d, and let fi,...,fm be of maximal degree 
6, maximal sparsity i and maximal transcendence degree r. First, we use a faithful 
homomorphism to transform C{fi, . . . , fm) into an r-variate circuit. Then, a hitting 
set for r-variate degree-c? polynomials is used, given by the following version of the 
Schwartz-Zippel lemma. 

Lemma 17 (Schwartz-Zippel). Let H C K be a subset of size d+ 1. Then Ti = is 
a hitting set for {/ G K[zi, . . . ,Zr]\ deg(/) < d}. 

Proof Cf. |Alo99l Lemma 2.1]. □ 

4.1 A hitting set (large or zero characteristic) 

We use the map \E' from Sect. 13. 2[ This hitting set construction is efficient for r constant 
and £, d polynomial in the input size. 

Let n,d,r,5,i > 1 and let K[z] = K[zo, Zi, . . . , Zr]. We introduce the following 
parameters. 

1. Define D = {Di.Di) by Di := {26ny'+^ and D2 := 2. 

2. Define p^ax := (2nr£)2('-+i) \\og^ Di]^ + 1. 

3. Pick arbitrary Hi, H2 C K of sizes ^rp^nax resp. d+ 1. 

Denote "^rl^p^c '■— ^D,p,c{xi) G K[z] for i = 1, . . . , n and define the subset 

'H,,r,s,e = { {^il,M), • • • , I P e [Pmax], c E H^, a E i^r'} C K\ 

The following theorem shows that, over a large or zero characteristic, this is a hitting 
set for the class of circuits under consideration. A proof is given in Appendix IC.ll 

Theorem 18. Assume that ch.{K) = or ch.{K) > 6^ . Then 'Hd,r,5,i is a hitting set for 
the class of degree-d circuits with inputs being i- sparse, degree-6 subcircuits o/trdeg at 
most r. It can be constructed in polj{dr6in)^ time. 
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4.2 A hitting set (arbitrary characteristic) 

We use the map $ from Sect. 13. 1[ This hitting set construction is efficient for S, r 
constants and d polynomial in the input size. 

Let n,d,r,S > 1 and let K[z] = K[zi, . . . ,z^\. We introduce the following parame- 
ters. 

1. Define D := + 1. 

2. Define p^ax := + ^'T^^" Roga I^? + 1. 

3. Pick arbitrary H^, H2 C K oi sizes S'Wpjaa.x resp. d+ 1. 

Denote $/£)pc '■— ^i,D,p,c{^i) ^ ^[^] for i = 1, . . . ,n and define the subset 

'H,,r,s = • • • , I ^ e (^')' P e [P-x], ceH„ae h;} c Z". 

The following theorem shows that this is a hitting set for the class of circuits under 
consideration. A proof is given in Appendix I C. 2 [ 

Theorem 19. The set'Hd,r,5 is a hitting set for the class of degree-d circuits with inputs 
being degree-6 subcircuits of transcendence degree at most r. It can be constructed in 
poly {dr6nY^'^^^ time. 

5 Depth-4 circuits with bounded top and bottom 
fanin 

The second PIT application of faithful homomorphisms is for Snsn^(/c, s, n) circuits. 
Our hitting set construction is efficient when the top fanin k and the bottom fanin 6 
are both bounded. Except for top fanin 2, our hitting set will be conditional in the 
sense that its efficiency depends on a good rank upper bound for depth-4 identities. 

5.1 Gcd, simple parts and the rank bounds 

Let C = Yl'i=i Y[j=i fij tie a T,IlT,Ils{k, s,n) circuit, as defined in Sect. II. 1[ Note that 
the parameters bound the circuit degree, deg(C) < 6s. We define an S{-) operator as: 

5(C) := \te[k] and j e [s]} C K[x]. 

It gives the set of sparse polynomials of C (wlog we assume them all to be nonzero). 
The following definitions are natural generalizations of the corresponding concepts for 
depth-3 circuits. Recall Tj := Ylj fi,j, for ^ ^ [k], are the multiplication terms of C. The 
gcd part of C is defined as gcd(C) := gcd(Ti, . . . ,Tk) (we fix a unique representative 
among the associated gcds). The simple part of C is defined as sim(C) := C/ gcd(C) G 
T,IlT,Ils{k, s,n). For a subset / C [k] we denote Cj := Yliiei'^i- 
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Recall that if C is simple then gcd(C) = 1 and if it is minimal then C/ 7^ for all 
non-empty / C [k]. Also, recall that rk(C) is trdegj^ S{C), and that Rs{k,s) strictly 
upper bounds the rank of any minimal and simple IlIlTiIls{k, s,n) identity. Clearly, 
Rs{k, s) is at most | S{C)\ < ks (note: S{C) cannot all be independent in an identity). 
On the other hand, we could prove a lower bound on Rs{k, s) by constructing identities. 

From the simple and minimal EIIS identities constructed in [SSJ , we obtain the lower 
bound Ri {k, s) = n{k) if ch{K) = 0, and Ri {k, s) = n{k log^ s) if ch(ii') = p > 0. These 
identities can be lifted to T,IlT,Ils{k, s,n) identities by replacing each variable Xi by a 
product of new variables. These examples demonstrate: Rs{k,s) = Q{6k) if 

ch.{K) = 0, and Rs{k, s) = Q{6k\ogp s) if ch{K) = p > 0. This leads us to the following 
natural conjecture. 

Conjecture 20. We conjecture 



The following lemma is a vast generalization of |KS08l Theorem 3.4] to depth-4 
circuits. It suggests how a bound for Rs{k, s) can be used to construct a hitting set for 
EnEn5(fc, s, n) circuits. The in the statement below should be thought of as a linear 
map that reduces the number of variables from n to Rs{k, s) + 1. 

Lemma 21 (Rank is useful). Let C be a TiIlT,Ils{k, s,n) circuit, let r := Rs{k,s) and 
let if : K[x] — )■ K[z] = K[zo, zi, . . . ,Zr] be a linear K -algebra homomorphism that, for 
all / C [k], satisfies: 

1. (y9(sim(C/)) = sim((y9(C/)), and 

2. rk(^(sim(Cj))) > min{rk(sim((:7^)), /^^(A;, s)}. 
Then C = if and only if (f{C) = 0. 

Proof U C = 0, then clearly if{C) = 0. Conversely, let if{C) = 0. Let / C [k] be a 
non-empty subset such that (fiiCi) is a minimal circuit computing the zero polynomial. 
Then, by assumption ([TJ), ip{sim{Cj)) = sim{ip{Ci)) G T,IlT,Ils{k, s,n) is a minimal 
and simple circuit computing the zero polynomial. Hence, Tk{(f{sim{Cj))) < Rs{k,s). 
By assumption ([2l), this implies rk(y9(sim(C/))) = rk(sim(C/)), thus ip is faithful to 
5(sim(C/)). Theorem [T2] yields sim(C/) = 0, hence Cj = 0. Since (p{C) is the sum of 
zero and minimal circuits ^p{Ci) for some / C [k], we obtain C = as required. □ 

5.2 Preserving the simple part (towards Theorem [2]) 

The following lemma shows that \E' meets condition ([1]) of Lemma [211 The proof is 
given in Appendix ID.ll This is also the heart of PIT when k = 2. The actual hitting 
set, though, we provide in the next subsection. 





otherwise. 
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Lemma 22 (\E' preserves the simple part). Let C be a IlIlTiIls{k, s,n) circuit. Let 
Di > 25^ + 1, let Di > D2 > 6 + 1 and let D = {Di,D2). Then there exists a prime 
p < (2/csn(5^)^'^^"'"^(log2 -Di)^ + 1 such that any subset S <Z K of size 25'^k'^s'^p contains 
c satisfying ^! D,p,c{^vcn.{C)) = sim^'^D^pAQ)- 

Proof sketch. For any coprime /j, fj G S{C) we look at their images under \E'. We view 
\E'(/j) and "^{fj) as univariates wrt Zq and fix zi = ■ ■ ■ = = 0. If we could keep these 
two univariates monic (before the fixing) and their resultants nonzero (after the fixing), 
then the coprimality of "^{fi) and "^{fj) would be ensured. Both those requirements 
are fulfilled by estimating the sparsity and using sparse PIT tricks. □ 

5.3 A hitting set (proving Theorems [2] &; [3]) 

Armed with Lemmas EH and [22] we could now complete the construction of the hit- 
ting set for Snsn5(/c, s,n) circuits using the faithful homomorphism with the right 
parameters. 

Let n,6, k, s > 1 and let r = Rs{k, s). We introduce the following parameters. They 
are blown up so that they support 2^ applications (one for each / C [k]) of Lemmas [16] 
and [22 

1. Define D = {Di, D2) by Di := {26nf'' and D2 := 6 + 1. 

2. Define p^^x := 2^(^+1) ■ {2krsn6y^'+'^^'' [logs ^if + 1- 

3. Pick arbitrary Hi,H2 C of sizes 2^~^'^k'^rs'^6'^pmax resp. Ss + 1. 
Denote ^^^^pc := '^D,p,c{^i) ^ ^[^] for i = 1, . . . ,n and define the subset 

ns,k,s = { (*gL(«), • • • , *&ic(«)) I P e [Pmax], ceH,,ae h;^'} c k\ 

The following theorem shows that, in large or zero characteristic, this is a hitting set 
for T,IlT,Ils{k, s,n) circuits. 

Theorem 23. Assume that ch(i^) = or ch(i^) > . Then 'Hs^k,s is a hitting set for 
TiIlTiIls^k, s,n) circuits. It can be constructed in poly(5rsn)'^ time. 

Since trivially Rs{2,s) = 1, we obtain an explicit hitting set for the top fanin 2 
case. Moreover, in this case we can also eliminate the dependence on the characteristic 
(because Lemma [22] is field independent). 

Corollary 24. Let K be of arbitrary characteristic. Then ^-5,2,3 is a hitting set for 
T,IlT,Ils{2, s,n) circuits. It can be constructed in po\j{6snY time. 

A proof of the theorem and the corollary can be found in Appendix ID. 21 
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6 Conclusion 



The notion of rank has been quite useful in depth-3 PIT. In this work we give the 
first generalization of it to depth-4 circuits. We used trdeg and developed fundamental 
maps - the faithful homomorphisms - that preserve trdeg of sparse polynomials in a 
blackbox and efficient way (assuming a small trdeg). Crucially, we showed that faithful 
homomorphisms preserve the nonzeroness of circuits. 

Our work raises several open questions. The faithful homomorphism construction 
over a small characteristic has restricted efficiency, in particular, it is interesting only 
when the sparse polynomials have very low degree. Could Lemma [15] be improved to 
handle larger 61 In general, the classical methods stop short of dealing with small 
characteristic because the "geometric" Jacobian criterion is not there. We have given 
some new tools to tackle that, for eg.. Corollary [5] and Lemmas [T4l and [T5l But more 
tools are needed, for eg. a homomorphism like that of Lemma [16] for arbitrary fields. 

Currently, we do not know a better upper bound for Rs{k,s) other than ks. For 
(5 = 1, it is just the rank of depth-3 identities, which is known to be 0(/c^logs) (0(A;^) 
over M) |SS10] . Even for 5 = 2 we leave the rank question open. We conjecture 
R2{k,s) = Ofc(logs) (generally. Conjecture [20]) . Our hope is that understanding these 
small 6 identities should give us more potent tools to attack depth-4 PIT in generality. 
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A Proofs for Sect. [2]: Preliminaries 



A.l Proofs for Sect. I2.lt Perron's criterion 

For the proof of Corollary |S] we will need three well-known lemmas. The first one is 
about resultants. For more information about resultants, see |CL097j . 

Lemma 25 (Resultant). Let f,g E K[x] such that deg^,(/) > and deg^.{g) > 
for some i E [n]. Then Tes^Xf^g) = z/ and only if f and g have a common factor 
h e K[x] with deg^^{h) > 0. 

Proof Cf. ICL0971 Chap. 3, §6, Proposition 1]. □ 

The following lemma identifies a situation where annihilating polynomials are unique 
up to a factor in K*. 

Lemma 26 (Unique annihilating polynomials). Let fi, . . . , fm € K[x] contain precisely 
m — 1 algebraically independent polynomials and let I C K[yi, . . . be the ideal of 
algebraic relations among fi, . . . , f^- Then I is principal. 



Proof. We follow the instructions of |vdEOO[ Exercise 3.2.7]. Assume that /i, . . . , fm-i 



are algebraically independent and let Fi,F2 G K[yi, . . . ,ym] be non-zero irreducible 
polynomials satisfying Fj(/i, . . . , fm) = for i = 1, 2. It suffices to show that Fi = CF2 
for some c G K*. 

For this, view Fi, F2 as elements of R[ym], where R = K[yi, . . . , ym-i], and consider 
the ?/m-resultant g := reSy^(Fi, F2) G R. By |CL097t Chap. 3, §5, Proposition 9], there 
exist gi, g2 G R[ym] such that g = giFi + (?2-^2- We have 

g{fl-, • • • , fm-l) = giifl, • • • , fm) ■ Fi{fi, . . . , fm) + 5'2(/l, • • • , fm) " -^2(/l, • • • , fm) 
= 0. 

Since fi, . . . , fm-i are algebraically independent, it follows that g = 0. By Lemma 
[25| Fi,F2 have a non-trivial common factor in R[ym]- Since Fi,F2 are irreducible, we 
obtain Fi = CF2 for some c G K*, as required. □ 

The following lemma contains a useful fact about annihilating polynomials and 
algebraic field extensions (cf. |Kay09 Claim 7.2] for a similar statement). 



Lemma 27 (Going to a field extension). Let fi, . . . , fm G K[x] and let L/K be an 

algebraic field extension. If there exists a non-zero polynomial F G L[y\ = L[yi, . . . , ym] 
such that F{fi, . . . , fm) = 0, then there exists a non-zero polynomial G G K[y] such 
that G{fi, . . . , fm) = and deg(G) < deg(F). In particular, fi,...,fm are algebraically 
independent over K if and only if they are algebraically independent over L. 
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Proof. Let F E L[y] he a non-zero polynomial such that F{fi, . . . , /„) = 0. Denote 
by ci, . . . , C£ G L the non-zero coefficients of F. Replacing L by K{ci, . . . , q), we may 
assume that L/K is algebraic and finitely generated (as a field) over K. By |Lan02^ 
Chapter V, §1, Proposition 1.6], this implies that [L : K] =: d < oo. Let bi, . . . ,bd E L 
be a i^-basis of L. Then we can write F as 

F = Fi-bi + --- + Fd-bd 

for some Fi, . . . ,Fd E K[y], not all zero, such that deg(Fj) < deg(F) for aA\ i = 1, . . . ,d. 
Substituting /i, . . . , /„, we obtain 

= ...,/„)= /^) ■ 6i + ■■■ + Fdifi, bd. 

The i^-linear independence of 6i, . . . , 6^ implies that all coefficients of 

F,{f,,...,UeK[x] 

are zero for i = 1, . . . ,d. (Here we use that the indeterminates L- linearly 

independent, because L/K is algebraic.) Therefore, some non-zero Fi yields a G G K[y] 
with the desired properties. □ 

Corollary [5l Let /i, . . . , G K[x] be algebraically dependent polynomials of maxi- 
mal degree 6 and trdeg r. Then there exists a non-zero polynomial F G K[yi, . . . , ym] 
of degree at most S'^ such that F(/i, ...,/„) = 0. 

Proof of Corollary O By Lemma |271 we may assume wlog that K is infinite. Fur- 
thermore, we may assume that m = r + 1 and /i, . . . , are algebraically indepen- 
dent. Let F G K[y] = K[yi, . . . ,yr+i] be a non-zero irreducible polynomial such that 
F{fi, . . . , /r+i) = 0. By Lemma dH there exists a linear i^'-algebra homomorphism 

V? : K[x] K[z] = K[zi, . . . ,Zr] 

which is faithful to {/i, . . . , fr+i}- Set gi := (p{fi) G K[z] for i = 1, . . . , r -|- 1. Then 
Qi, . . . , Qr+i are of degree at most 6 and by Theorem H] there exists a non-zero polynomial 
G G K[y] such that G{gi, . . . , (^r+i) = and deg{G) < 6"^. But since 

F{g,, gr+i) = Fi^if,), <^(/,+i)) = <^(F(/i, . . . , /,+i)) = 0, 

Lemma [26] implies that F divides G. Hence, deg(F) < deg(G) < 5*". □ 

A. 2 Proofs for Sect. 12. 2t Jacobi's criterion 

In the proof of the Jacobian criterion we will make use of the following facts about 
partial derivatives. Let / G i^[a;]. First assume that ch(i^) = 0. Then, for i G [n], we 
have 

d^J = if and only if / G K[xi, Xi-i,Xi+i, . . . , 
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Therefore, we have dx^if) = for all z = 1, . . . , if and only if / = 0. Now assume 
ch(i^') = p > 0. Then, for i G [n], we have 



dxj = if and only if / G K[xi, Xi-i, , Xj+i, . . . 



Hence, dx^f = for alH = 1, . . . , n if and only if / G K[x\, . . . , x^]. If, in addition, K is 
a perfect field (in characteristic p this means that every element of is a p-th power), 
then we have dxj = for alH = 1, . . . , n if and only if f = for some g G i^'[a:;]. An 
example of a perfect field is the algebraic closure K of K. 

Now let K be an arbitrary field, let fi,...,fm G K[x] and let Fi, . . . ,Fs G -ft't?/]. 
Then, by the chain rule, we have 

Jx{Fi{fi, . . . , /m), • • • , Fs{fi, . . . , /m)) 

= {jyi.Fi, . . . , Fs)){fi, . . . , /m) ■ Ja;(/l, • • • , /m)- 

Now we are prepared to proceed with the proofs. 

Lemma El Let fi, ■ . . , fm e K[x]. Then trdeg^{/i, . . . , fm} > rk^^ J^(/i, . . . , fm), 
where L = K{x). 

Proof of Lemma^ Let r = ik^ J^ifi, ■ ■ ■ , fm)- We may assume that the first r rows 
of J(/i,...,/m) are L-linearly independent. Assume, for the sake of contradiction, 
that fi, . . . , fr are algebraically dependent. Choose a non-zero polynomial F E K[y] = 
K[yi, ... ,yr] of minimal degree such that F{fi, . . . , fr) = 0. Differentiating with respect 
to Xi, . . . ,Xn using the chain rule yields the vector- matrix equation 



fdxji ■■■ dx„fi\ 

\9xifr ' ' ' ^Xn fr j 



0. 



Since this matrix has rank r over L, it follows that {dy.F){fi, . . . , fr) =0 for all i = 
1, . . . , r. Since the degree of F was chosen to be minimal, it follows that dy-F = for all 
i = 1, . . . ,r. If ch.{K) = 0, this implies F = 0, a. contradiction. If ch(i^') = p > 0, this 
implies F G K[yi, . . . , y^]. Since K is perfect and F ^ 0, there is a non-zero G G K[y] 
such that F = G^. From 



= F(/i,...,/,) = G(/i,...,/, 



p 

1 J r J 



wee see that . . . , fr) =0. By Lemma [271 there exists a non-zero G' G K[y] such 

that G"(/i, . . . , /r) = and deg(G') < deg(G') < deg(F). This contradicts the choice 
of F. Therefore, /i, . . . , are algebraically independent, hence trdeg({/i, . . . , fm}) > 
r. □ 

Theorem [G]. Let /i, . . . , G -ft'[a^] be polynomials of degree at most S and trdeg r. 
Assume that ch{K) = or ch(fr) > 5^ Then rk^ Ja;(/i, . . . , fm) = trdeg^.{/i, . . . , fm}, 
where L = K{x). 
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Proof of TheoremlB Let r = trdeg{/i, ...,/„}• By Lemma [TJ we have 

r > rki, J(/i,. . .Jm), 

so it remains to show the converse inequahty. 

After renumbering fi,...,fm and xi,...,Xn, we may assume that the polyno- 
mials fi, . . . , fr, Xr+i, . . . ,Xn are algebraically independent. Consequently, for i = 
1, . . . ,n, there exist non-zero polynomials Fi G K[yQ, . . . ,yn] of minimal degree such 
that degy^{Fi) > and 



Fi(^Xi, fi, . . . , fr, x^+i, 



0. 



(2) 



By Theorem m (with (n — r + 1) of the 5j's being 1), we have deg(Fj) < 6^. Hence, by 
the assumptions on ch.{K), we have dy^Fi ^ 0. Since the degree of Fi was chosen to be 
minimal, we have 

i^yo-^i) i-^iy /l) • • • ) frj 3;,. -1-1, . . . , Xn) 0. 



Denote 

for j = 0, 
yields 



for k = 1, 



■ idy^F,i^{Xi, fi, • • • , fry ■^r+ly • • • ) ■^n) 

, n. Differentiating equation ^ with respect to x^ using the chain rule 



Gifi ■ 6i^k + ^ Gij ■ dx^fj + ^ Gij ■ 6j^, 

j=l j=r+l 

n. Since Gi^o ^ 0, this can be rewritten as 







-Gi 



-Gi 



■ 1 Gio 

This shows that the block diagonal matrix 



G 



i,Q 



\ 



dxi fr 



9xr fr 



1 / 



is invertible. Therefore, the first r rows of J(/i, . . . , fm) are L-linearly independent and 
hence r < rk^ J(/i, . . . , Z^). □ 
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A. 3 Proofs for Sect. 12. 3t Krull dimension 



Corollary [9l Let A, B be i^'-algebras and let : A — )■ i? be a i^'-algebra homomor- 
phism. If A is an affine algebra, then so is <^{A) and we have dim.{ip{A)) < dim(y4). If, 
in addition, is injective, then d\m.{ip{A)) = dim(A). 

Proof of Corollaryl^ Since A is an affine algebra, there exist ai, . . . ,am. & A such that 
A = K[ai, . . . , am]- Then (p{A) = K[{p{ai), . . . , ip{am)] is finitely generated as a K- 
algebra as well. 

Now assume for the sake of contradiction that d := dim{ip{A)) > dim(yl). By 
Theorem [HI there exist ai, . . . , G A such that ip{ai), . . . , (p{ad) are algebraically inde- 
pendent. Since d > dim(A), the elements oi, . . . , are algebraically dependent. Hence, 
there exists a non-zero polynomial F G K[yi, . . . , such that F{ai, . . . , ad) = 0. It 
follows that 

= <p{F{ai, ad)) = F(v9(ai), . . . , (^{ad)) 

and this implies that (p{ai) , . . . , ip{ad) are algebraically dependent, a contradiction. 
Therefore, dim{ip{A)) < dim(A). 

Now let ip be injective, let d := dim(A) and let ai,...,ad G A he algebraically 
independent. Assume for the sake of contradiction that ip{ai), . . . ,ip{ad) are alge- 
braically dependent. Then there exists a non-zero polynomial F G K[yi, . . . ,yd] such 
that F{(p{ai), . . . , f{ad)) = 0. From 

= F(v5(ai), . . . , (fiad)) = ^{F{ai, ad)) 

we see that F{ai, . . . ,ad) = 0, because ip is injective. But this means that ai, . . . , 
are algebraically dependent, a contradiction. Thus dim{ip{A)) > dim(74). □ 



B Proofs for Sect. [St Faithful homomorphisms 

Let P denote the set of prime numbers and sp(/) denote the sparsity of a polynomial 

In the proofs of Lemmas [151 [E] and [22] we will use the following well-known facts. 

Lemma 28 (Sparse PIT). Let i > 1 and d > 2. Let R be a commutative ring and let 
f G R[t] be a non-zero polynomial of sparsity at most i and degree at most d. Then 
there are at most £ ■ log2(c?) — 1 prime numbers p such that / = (mod {t^ — • 

Proof. Cf. [BHLVOQl Lemma 13] and note that the given proof also works for polyno- 
mials over a ring (instead of a field). □ 

Lemma 29 (Primes). Let r G R-^. Then the interval [l,r^ + 1] contains at least [r] 
prime numbers. 

Proof Cf. |Pap95i Claim on p. 478]. □ 
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B.l Proofs for Sect. 13.1b A Kronecker- inspired map 

Lemma 1141 Let K be an infinite field and let fi, ■ ■ ■ , fm G K[x] be polynomials of 
trdeg r. Then there exists a linear i^'- algebra homomorphism : K[x] ^ K[z\ which 
is faithful to {/i, . . . , fm]- 

Proof of Lemma^I^ After renumbering fi, . . . , fm and Xi, . . . , a;„, we may assume that 
fi, . . . , fr, Xr+i, . . . ,Xn are algebraically independent. Consequently, for i = 1, . . . , r, 
there exists a non-zero polynomial Gi G K[yQ, yi, . . . , such that degy^(G'j) > and 

Gi(^Xi, fi, • • • , fn Xf^i, . . . , Xn) 0. 

Denote by gi G K[yi, . . . ,yn] the (non-zero) leading coefficient of Gi as a polyno- 
mial in yQ with coefficients in K[yi, ...,?/„]. The algebraic independence of /i, . . . , fr, 
Xr+i, ■ ■ ■ ,Xn implies 

9i{fly • • • 5 fry Xr+l, . . . ,Xn 

Since K is infinite, there exist c^+i, . . . , c„ G such that 

i.9ii.fl 1 ■ ■ ■ y fr, Xr+1 ) • • • 5 3^n) ) (-^l ; • • • ; Xr, Cf +i , . . . , Cn) 

for all z = 1, . . . , r. Now define the i^'-algebra homomorphism 



ip : K[x] K[z], Xi 



i, if 1 < i < r, 
Cj, otherwise. 



Then, by the choice of c^+i, . . . , c^, we have 

Cid/O, V'l/l), • • • , V5(/r), Cr+1, . . . , c„) 7^ 

and 

Gi{Zi,^{fl),. . . ,(p{fr),Cr+l,. . . ,Cn) = 

for i = 1, . . . , r. This shows that Zi is algebraically dependent on ip{fi), ... ,ip{fr) for 
2 = 1, . . . , r. It follows that 

trdeg{¥?(/i), . . . , (fifm)} = r = trdeg{/i, . . . , fm}, 

hence ip is faithful to {/i, . . . , □ 

Lemma 1151 Let fi, . . . , fm G K[x] be polynomials of degree at most S and trdeg 
at most r. Let D > 6^~^^. Then there exist an index set I G and a prime 
p < {n + 5'')^^'^^ (log2 -D)^ + 1 such that any subset of K of size 6^rp contains c such 
that $/,D,p,c is faithful to {/i, . . . , /„,}. 
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Proof of LemmallM We may assume wlog that trdeg{/i, . . . , fm} = r and, after renum- 
bering fi,...,frn, that 

/l) • • • ) /r; ^jr+l ! • • • ; -^jn 

are algebraically independent for some jV+i, ■ ■ ■ ,jn £ [n] with j^+i < ■ ■ ■ < jn- Denote 
the complement [n] \ {jr+i, . . . , jn} by J = {ji, . . . where ji < ■ ■ ■ < jr- By Corol- 
laryO there exists a non-zero polynomial Gi G K[yQ, yi, . . . , such that deg(Gj) < 6^, 
degy^id) > and 

Cri{Xj-, fi,...,fr, 3^jV+l5 • • • 5 -^jVi) ~ 

for i = 1, . . . , r. Denote by (^j G . . . , ?/„] the (non-zero) leading coefficient of Gi 

as a polynomial with coefficients in . . . , ?/„]. The algebraic independence of 

/i,---,/r, a:jv+i,...,Xj„ implies 

We have 

deg(^»(/i, . . . , /r, • • • , XjJ) < 5''+^ < D. 
Therefore, the polynomial 

hi := . . . , $/,D(/r), $/,D(a:j.+J, • • • , ^lA^jJ) ^ K[t, z] 

is non-zero (this is the classical Kronecker substitution: D is so large that the monomials 
remain separated). We have 

degtih,) < 5'^+^ ■{D + D^ + --- + D"-'') < 

Also, the sparsity of hi (short, sp) can be bounded as: 

sp{hi) = sp{gi{fi,...Jr,Xj^^,,...,XjJ) 



< sp{gi) ■ max{sp(/i), . . . , sp(/r)} 
< 



deg(9i) 



n + 6 ''"\ / n + 6 



6^ J \ 6 
< {n + 6'f ■ {n + 6f''\ 

Let Bi C F he the set of all primes p satisfying = (mod {t^ — l)K[t,z])- Then 
\Bi\ <{n + l){n + 6''Y\n + 6)^'^' \og^ D by Lemma El Finally set := 5i U • ■ ■ U B^. 
Then 

\B\ < r{n + l)(n + 5'Y\n + 5)^''^' log^D < {n + log^D. 

Now pick a suitable prime p G P \ i? (by Lemma [291) . Let z G [r]. Then hi ^ 
(mod (tP - l)A'[t,2]). Define 



/ij^^ := ^i($/,D,p(/i), • • • , -^-AApl/r), $7,i?,p(a;j.+J, . . . , ^i,D,p{^jJ) e ^[t, 



2; 
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Since hf^ = hi (mod {fP - l)Kit,z]), we have hf'> ^ 0. Let Si C K he the set 
of all c e K such that h'f\c, z) = 0. Then |^,| < degtih'f^) < 6''p. Finally set 
^ := ^1 U ■ ■ ■ U S',. Then |^< r5>. 
Now let ie[r]andce K\ S. Then 

Gr{yo, $/,D,p,c(/l), . . . , $7,D,p,c(/r), CL^'J^ . . . , cL^""^J^) ^ 0, 

because /ij-^^(c, z) ^ 0, and 

$/,D,p,c(/l), . . . , <^>/,D,p,c(/r), CL^'J^ . . . , cL^"-^J'') = 0. 

This shows that Zi is algebraically dependent on $/,_d ,p,c(/i ),•••, '^'/,D,p,c(/r) for i = 
1, . . . , r. It follows that 

trdeg{$/,D,p,c(/i), • • • , ^i,D,p,cifm)} = r = trdeg{/i, ...,/,„} 
for all c e Z \ ^. □ 



B.2 Proofs for Section 13.2b A Vandermonde-inspired map 

Lemma 1161 Let fi, ■ ■ ■ , fm ^ K[x] be polynomials of sparsity at most i, degree at 
most 6 and trdeg at most r. Assume that ch(i^') = or ch(i^') > 6^'. Let D = {Di, D2) 
such that Di > max{5r + l,{n + 1)''+^} and D2 > 2. Then there exists a prime 
p < {2nriy^^~^^\\og2 Di)"^ + 1 such that any subset of K of size 5rp contains c such that 
'^D,p,c is faithful to {/i, . . . , Z^}. 

Proof of LemmaUU Let s := trdeg{/i, . . . , fm} < r and let ii, . . . ,is G [m] such that 
/j^, . . . , fi^ are algebraically independent. By the chain rule, we have 

Jzu...,zA'^D{fiJ,...,'^D{f^J) 

= (^(^,...,/*J)(^d(xi),...,^d(x„)) ■ J.i,...,.,(^d(xi),...,^d(x„)). (3) 

We introduce some notation. Define the polynomial 

/' := det J.,,...,.,(^D(/n), . . . , ^DifiJ) e K[t, z] 

and set / := /'(t, 0, . . . , 0) G K[t\. For an index set / = G with 

ji < ■ • ■ < js, denote 

:= (det J,^.^„„,,^J^,...,/,J)(^D(xi),...,^'i,(x„)) G z] 

and 

/i', := det J.i,...,.,(^d(x,J, . . . , ^d(x,J) G z], 
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and set gi := ^^(t,0...,0) e K[t] and hi := /^^(t, 0, . . . , 0) G Applying the 

Cauchy-Binet formula (cf. |Zen93j ) to ([3]) and substituting (t, 0, . . . , 0) for (t, -Zq, • • • , ^r), 
we obtain 

f = J29i-hi, (4) 
/ex 

where X := {/ G (^"') | (7/ 7^ 0}. We want to prove that / 7^ 0. It suffices to show that 
there is a unique / G X for which deg{gi ■ hj) is maximal. 

First we show that X 7^ 0. Since /j^, . . . , /j^ are algebraically independent, there 
exists / = {ji, . . . , G with ji < ■ ■ ■ < such that 



det J^^.^,...,^^J/i,,...,/,J 7^ 

by Theorem |6l We have 

deg(det Jx,,,...,x,, (/ii, • • • , /ij) < 5s < Sr. 

Since -D > 5r + 1, it follows that gi ^ (this is the classical Kronecker substitution: D 
is so large that the monomials remain separated), hence / G X. 

Next we want to show that /i/ 7^ and deg{hi) < D for all / G and we 

want to show that deg{hi) 7^ deg^hj/) for all /, /' G with / 7^ /'. To this end, let 
I = {ji, • • • , e (fj) with ji < ■ ■ ■ < j,. Then 



hi = det I I 

where &s denotes the symmetric group on {1, . . . , s} and 

:= + + ■ ■ ■ + j,{n + 1)'^^ G N. 

It is not hard to show that did > d^ for all cr G \ {id}. This implies hi ^ and 

degihi)=j^{n + iy + ---+jsin + iy < (n + 1)^+^ < {n + lY+^<D. 

From the degree formula it is not hard to deduce that deg{hi) 7^ deg(/i//) for all /, /' G 
([J) with J ^ J'. 

Now denote by X^ax ^ X the set of all J G X such that deg{gi) is maximal. Let 
/ G Xinax and let /' G X \ X^ax- Observe that, by construction, we have deg{gi) — 
deg{gi') > D. Since deg(/i//) < it follows that 

deg{gi ■ hi) > deg{gi) > deg{gr) + D > deg{gr) + deg{hr) = deg{gr ■ hp). 

Therefore, the summands in (jl]) of maximal degree have an index set in X^ax- 

Finally, let / G X^ax be the unique index set such that deg(/i/) is maximal. Then 
gi ■ hi is the unique summand in (jl]) of maximal degree. This implies / 7^ 0, as required. 
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By (jll), we have 



sp(/) < C ] ■{s\-t)-s\< {nsiy < {nri 



and 

deg(/) <r5-{Di + Dl + --- + D1) + {n + 1)"+^ < D^^+i + A < ^r^- 
Let 5 C P be the set of all primes p satisfying / = (mod (t^ — Then 
|5| < {n + 2){nrty\og2Di < (2nr£)"+Mog2 £>! 



by Lemma [ 

Now pick a suitable prime p G P\i? (by Lemma [29]) . Then / 7^ (mod (t^ — 
This implies /' 7^ (mod (t^ — V)K[t,z\)- Define 

/(P) := det J.„...,..(vl/z),p(/n), • • • , ^Ap(^)) ^ ^^[t, 2;]. 

Sinc^/(P) = /' 7^ (mod (t^ - we have /(p) ^0. Let 5 C Z be the se^f all 

ceK such that /(p)(c, z) = 0. Then \S\ < degt{fP^) < 5sp < 5rp. Now let c G \ ^. 
Then 

det J.„...,.,(vl/z),p,c(/n), • • • , ^D,p,c(^)) = /(^Hc, 7^ 0. 

By Theorem[6l this means that D,p,c{fh)y • ■ • 5 '^D,p,c{fis) are algebraically independent, 
hence 

trdeg{^fD,p,c(/i), • • • , ^D,p,c{fm)} = s = trdeg{/i, . . . Jm} 
for all c G Z \ □ 



C Proofs for Sect. St Proving Theorem [T] 
C.l Proofs for Sect. I4.lt A hitting set 

Theorem 1181 Assume that ch.{K) = or ch.{K) > 6^. Then 'Hd,r,s,e is a hitting set for 
the class of degree-d circuits with inputs being ^-sparse, degree-(5 subcircuits of trdeg 
at most r. It can be constructed in po\j{dr6inY time. 

Proof of TheoremlTSi Let C(/i, . . . , fm) be a non-zero circuit of degree at most d with 
subcircuits /i, . . . , of sparsity at most i, degree at most 6 and trdeg at most r. By 
the choice of parameters, Lemma [16] implies that there exist a prime p G [pmax] and an 
element c E Hi such that '^d,p,c is faithful to {/i, . . . , fm}- Hence, by Theorem [T2l 

^D,p,c(C(/l, ...,fm))= C{^D,pAfl), '^D,pAfm)) 

is a non-zero circuit with at most r + 1 variables and of degree at most d. Now 
the first assertion follows from Lemma [T71 The second assertion is obvious from the 
construction. □ 
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C.2 Proofs for Sect. 14. 2t Arbitrary characteristic 



Theorem 1191 The set 'Hd,T,5 is a hitting set for the class of degree-ci circuits with inputs 
being degree-(5 subcircuits of transcendence degree at most r. It can be constructed in 
Y)o\y {drdny^"^^^ time. 

Proof of Theorem\l^ Let C(/i, . . . , /„) be a non-zero circuit of degree at most d with 
subcircuits /i,...,/^ of degree at most 5 and trdeg at most r. By the choice of 
parameters, Lemma [15] imphes that there exist an index set / G ('^'), a prime p e [pmax] 
and an element c & Hi such that $/,_D,p,c is faithful to {/i, . . . , /m}- Hence, by Theorem 

m 

^I,D,pAC{fl, ■■■Jm))= C($/,i?,p,e(/l), • • • , $/,D,p,c(/m)) 

is a non-zero circuit with at most r variables and of degree at most d. Now the first 
assertion follows from Lemma [T71 The second assertion is obvious from the construction. 

□ 



D Proofs for Sect. [5]: Depth-4 circuits 

D.l Proofs for Sect. 15. 2t Preserving the simple part 

Lemma ^ Let C be a EUT^Hsik, s,n) circuit. Let Di > 25^ + let Di > D2 > 
6+1 and let D = {Di,D2). Then there exists a prime p < {2ksn6'^Y^^~^'^{\og2 DiY 
+1 such that any subset S G K of size 25^k'^s^p contains c satisfying \E'£) p c(sim(C)) 

Proof of LemmalME Let fi,...,fm € K[x] be the non-constant irreducible factors of 
the polynomials in S{C). Then m < ks6 and we have 

deg(/,) < S and sp(/,) < < (n + S)' 

for alH = 1, . . . , m. 

First we make the following observation. U ip : K[x] ^ ^i^] is a i^T-algebra homo- 
morphism such that 

1. <f{fi) is non-constant, for alH = 1, . . . , m, and 

2- gcd(/i, fj) = 1 implies gcd{(p{fi), vUj)) = 1> for all 1 < i < j < m, 

then 9?(sim(C)) = sim(y9(C)). To satisfy the first condition we will ensure that the 
images of fi, ■ ■ ■ , fm under \& are monic in zq. This will also facilitate our task of 
meeting the second condition. Here we will use resultants with respect to zq to preserve 
coprimality. 

So let i G [m] and define 

9r :=/.(t^V..,t^^>i^W. 
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Since deg(/j) < D2, we have gi (Kronecker substitution). We have 

deg(^,) <6-{D, + Dl + --- + < ^2"+! 

and sp((7j) = sp(/j) < {n + 6y. Let Bi i C P be the set of all primes p satisfying gi = 
(mod {fP - l)Kit])- Then \Bi^i\ < {n + l)(n + 5)''log2i:'2 by Lemma EH Finally, set 
Bi := Bi^i U • ■ ■ U Bi^^. Then 

\Bi\ < m{n + l){n + 5Y\og2D2 < ks5 {n + 1) (n + 5Y log^ D2. 

Now let i G [m] and define 

hi := fi{xi+t^ho,...,Xn + t^^Zo) G K[t,Zo,x]. 

Then the leading term of hi as a polynomial in 2:0 is gi. In particular, hi ^ 0. We have 

sp(/iO < 2^ • sp(/,) < 2\n + 5)'^. 

Now let i,j G [m] with i < j such that gcd(/i,/j) = 1. Then gcd{hi,hj) = 1, 
because the map: 

ir(t,2;o)[a;] ^ /^(t, 2;o)W, Xi y-)- Xi + t^^'zo (i = l,...,n) 

is a -2o)-algebra automorphism. This implies reszoihi, hj) 7^ 0. We have 

deg^{Tes,,{hi,hj)) < 26^ < Di, 

therefore the polynomial 

hij := res,„ 2:0, 0, . . . , 0), 2:0, 0, ... , 0)) G Zq] 

is non-zero (Kronecker substitution). We have 

degi(/i,,,) <25^ ■iD^ + Dl + --- + D^) < D1+^ 

(using Di > D2) and 

sp(/iij) < max{sp(/ii), sp(/ij)}2^ < 2^^\n + 5)2"^'. 

Let -B2,i,j C P be the set of all primes p satisfying hi^j 7^ (mod (t^ — V)K[t,zo])- Then 
1^2,^1 < {n + l)2'^^^{n + 5f^^\og2Di by Lemma ED Finally, set B2 := Uj^2,i,j, where 
the union is over all i,j G [m] with i < j such that gcd(/i, fj) = 1. Then 

IB2I < lm^{n + l)2^'\n + Sf'"hg2D, 
< l{ks6)\n + l)2^'\n + 6f'' log2 Di. 
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Ultimately, set B := B1UB2. Then 

|5| < 2 1^2! < {ks6y{n + l)2^^\n + 6f^' logs ^1 

Now pick a suitable prime p E F \ B (by Lemma [29]) . First, let i G [m]. Since 
p ^ we have gi (mod (t^ — l)i^[t]). Define 

gip) :=/,(tL^^J.,...,tL^?J.)eir[t]. 

Since g'f^'' = Qi ^ (mod (t^ — we have g^^^ 7^ 0. Let Si^i C K he the set 

of all c G Z such that gl^\c) = 0. Then \Si,i\ < deg(c/f ^) < Sp. Finally, set ^1 := 
Si^i U ■ ■ ■ U Si^m- Then l^il < m6p < ksS'^p. Now let i,j G [m] with « < j such that 
gcd(/i, fj) = 1. Since p ^ ,82, we have hij ^ (mod (t^ — \)K\t,zii])- Define 

h^^ := res,„ ((^B,p(/0)(t, ^0, 0, . . . , 0), (^,5,p(/,))(t, ^o, 0, • • • , 0)) G /^[t, Zq]- 

Since /i-j = /lij 7^ (mod (t^ — l)x[t,zo])5 we have /i-^- 7^ 0. Let 5*2,1^ d K he the set 
of all c G Z such that }if]{c,z^) = 0. Then \S2,rj\ < degt{h[^j) < 25'^p. Finally set 

:= Uj j where the union is over all i, j G [m] with i < j such that gcd(/j, fj) = 1. 
Then |52| < ■ 25^^ < S^k^s^p. Ultimately, set S := SiU S2. Then \S\ < 26^Ps^p. 

Let i G [m]. Then D,p,cWi) is monic in for all c G K\S. Now let i, j G [m] with 
z < j such that gcd(/i, fj) = 1. Then 

I res2:Q (^Ap,c(/i),^D,p,c(/i)))(^0,0,...,0) 

= res,o {{^D,p,c{fi))izo, 0, . . . , 0), {'^D,pAfi)){^o, 0, . . • , 0)) 

= /ig(c,Zo)^0 

for all c G K\S. Thus, res^Q(\l/D^p^c(/i), ^_D,p,c(/i)) 7^ and by Lemma [25] it follows 
that gcd(^B,p,,(/-,), ^D,p,c(/,)) = 1 for all c g':^\ ^. □ 

D.2 Proofs for Sect. [ES A hitting set 

Theorem 1231 Assume that ch(i^) = or ch(i^) > S^'. Then 'Hs,k,s is a hitting set for 
T,IlT,Ils{k, s,n) circuits. It can be constructed in poly (Srsn)^^'"^ time. 

Proof of Theorem\2^ Let C G TJ\nis{k, s, n) be a non-zero circuit. First, let us show 
by a loose estimation that our parameters afford 2^ applications of Lemmas [16] and [22] 
(one for each S{Ci) resp. C/, for all / C [A;]). The number of 'bad' primes by the proofs 
of these lemmas are at most: 

2^-{2nr{n + dfY^^ logs Di + 2^- {2ksn5Y^'^' hg^ Di 

< 2^ ■ {2nr ■ 2n5Y^''+^^ log^ Di + 2^' ■ {2ksn6Y^'+^ log^ Di 

< 2'= ■ (2nr5)2^(''+^) log2 + 2'- ■ {2ksn6Y^'-^^ logs ^1 

< 2'=+! • {2krsn6Y^'+^^'' logs /^i. 
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Thus, the set [pmax] would have a 'good' prime p (by Lemma [29]). Next comes the 
estimate on the number of 'bad' c: 

2Hrp + 2^= ■ {25^k^s^p) < 2''+^kV6^p. 

Thus, Lemma [16] and Lemma [22] imply that there exist a prime p G [pmax] and an 
element c E Hi such that, for all J C [k], we have 

1. ^'£,,p,c(sini(C/)) = sim(^B^p^c(C/)), and 

2- ^D,p,c is faithful to some subset {/i, . . . , /„} C 5(sim(C/)) of transcendence de- 
gree min{rk(sim(C/)), r}. 

Hence, by Lemma [21], \E'£) j, ^(C) is a non-zero circuit with at most r + 1 variables and 
of degree at most Ss. Now the first assertion follows from Lemma [T7] The second 
assertion is obvious from the construction. □ 

Corollary I24L Let K be of arbitrary characteristic. Then ^,5,2,3 is a hitting set for 
Snsn5(2, s,n) circuits. It can be constructed in po\j{6snY time. 

Proof of Corollary First observe Rs{2,s) = 1. Since \Ef sends non-constant sparse 
polynomials of a circuit to non-constant polynomials (see the proof of Lemma [22]) . it is 
faithful to sets of transcendence degree 1 . Hence we do not need to invoke Lemma [TBI 
(where the dependence on the characteristic came from). □ 



32 



